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§0. Introduction 

This paper deals with some questions about the dynamics of diffeomorphisms of R^. A 
"model family" which has played a significant historical role in dynamical systems and 
served as a focus for a great deal of research is the family introduced by Henon, which may 
be written as 

fa,bix,y) = (a-by - x^,x) b ^ 0. 

When 6 7^ 0, is a diffeomorphism. When 6 = these maps are essentially one dimen- 
sional, and the study of dynamics of fa,o reduces to the study of the dynamics of quadratic 
maps 

faix) = a - X^. 

Like the Henon diffeomorphisms of R^ , the quadratic maps of R, have also played a central 
role in the field of dynamical systems. 

These two families of dynamical systems fit together naturally, which raises the ques- 
tion of the extent to which the dynamics is similar. One difference is that our knowledge 
of these quadratic maps is much more thorough than our knowledge of these quadratic 
diffeomorphisms. Substantial progress in the theory of quadratic maps has led to a rather 
complete theoretical picture of their dynamics and an understanding of how the dynam- 
ics varies with the parameter. Despite significant recent progress in the theory of Henon 
diffeomorphisms, due to Benedicks and Carleson and many others, there are still many 
phenomena that are not nearly so well understood in this two dimensional setting as they 
are for quadratic maps. 

One phenomenon which illustrates the difference in the extent of our knowledge in di- 
mensions one and two is the dependence of the complexity of the system on parameters. In 
one dimension the nature of this dependence is understood, and the answer is summarized 
by the principle of monotonicity. Loosely stated, this is the assertion that the complexity 
of fa does not decrease as the parameter a increases. The notion of complexity used here 
can be made precise either in terms of counting periodic points or in terms of entropy. 
The paper [KKH] shows that monotonicity is a much more complicated phenomenon for 
diffeomorphisms. In this paper we will focus on one end of the complexity spectrum, the 
diffeomorphisms of maximal entropy, and we will show to what extent the dynamics in the 
two dimensional case are similar to the dynamics in the one dimensional case. In the case 
of quadratic maps complex techniques proved to be an important tool for developing the 
theory. In this paper we apply complex techniques to study quadratic (and higher degree) 
diffeomorphisms. 

* Research supported in part by the NSF. 
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Topological entropy is a measure of dynamical complexity that can be defined either for 
maps or diffeomorphisms. By Friedland and Milnor [FM] the topological entropy of Hcnon 
diffeomorphisms satisfies: < htop{fa,b) < log 2. We will say that / has maximal entropy 
if the topological entropy is equal to log 2. The notion of maximal entropy makes sense for 
polynomial maps of R as well as polynomial diffeomorphisms of of degree greater than 
two. In either of these cases we say that / has maximal entropy if htop{f) = log(c?) where 
d is the algebraic degree of / and d > 2. We will see that this condition is equivalent to 
the assumption that has d^ (real) fixed points for all n. 

The quadratic maps fa of maximal entropy are those with a > 2. These maps are 
hyperbolic (that is to say expanding) for o > 2, whereas the map /2, the example of 
Ulam and von Neumann, is not hyperbolic. Examples of maps of maximal entropy in the 
Henon family were given by Devaney and Nitecki [DN] (see also [HO] and [O]), who showed 
that for certain parameter values fa,b is hyperbolic and a model of the Smale horseshoe. 
Examples of maximal entropy polynomial diffeomorphisms of degree d > 2 are given by 
the d-fold horseshoe mappings of Friedland and Milnor (see [FM, Lemma 5.1]). 

We will see that all polynomial diffeomorphisms of maximal entropy (whether or not 
they are hyperbolic) exhibit a certain form of expansion. Hyperbolic diffeomorphisms have 
uniform expansion and contraction which implies uniform expansion and contraction for 
periodic orbits. To be precise, let p be a point of period n for a diffeomorphism /. We 
say that p is a saddle point if Df'^{p) has eigenvalues A*/" with |A*| < 1 < [A^^l. If / 
is hyperbolic then for some k > 1 independent of p we have jA'^l > and |A*| < k^. 
On the other hand it is not true that uniform expansion/contraction for periodic points 
implies hyperbolicity. A one dimensional example of a map with expansion at periodic 
points which is not hyperbolic is given by the Ulam- von Neumann map. This map is 
not expanding because the critical point, 0, is contained in the non-wandering set, [—2, 2] 
(which is also equal to K). The map satisfies the above inequalities with k = 2. In fact 
for every periodic point of period n except the fixed point p = —2 we have \Df'^{p)\ = 2". 
At p = -2 we have n = 1 yet \DP{p)\ = 4. 

Theorem 1 . If f is a maximal entropy polynomial diffeomorphism, then 

(1 ) Every periodic point is a saddle point. 

(2) Let p be a periodic point of period n. Then \X^{p)\ < and |A"(p)| > d'^. 

(3) The set of fixed points of /" has exactly d^ elements. 

Let K be the set of points in R^ with bounded orbits. In Theorem 5.2 (below) we show 
that K is a Cantor set for every maximal entropy diffeomorphism. By [BS8, Proposition 
4.7] this yields the strictness of the inequalities in (2). Note that the situation for maps of 
maximal entropy in one variable is different. In the case of the Ulam- von Neuman map K 
is a connected interval and the strict inequalities do not hold. 

We note that by [BLS], condition (3) implies that / has maximal entropy. Thus 
we see that condition (3) provides a way to characterize the class of maximal entropy 
diffeomorphisms which makes no explicit reference to entropy. As was noted above, we 
can define the set of maximal entropy diffeomorphisms using either notion of complexity: 
they are the polynomial diffeomorphisms for which entropy is as large as possible, or 
equivalently those having as many periodic points as possible. 
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For the Ulam-von Neumann map the fixed point p = —2 which is the left-hand end- 
point of K is distinguished as was noted above. This distinction has an analog in dimension 
two. Let p be a saddle point. Let W^^^{p) denote the stable and unstable manifolds of 
p. These sets are analytic curves. We say a periodic point p is s/u one-sided if only one 
component of W^^'^ — {p} meets K. For one-sided periodic points the estimates of Theorem 
1 (2) can be improved. If p is s one-sided, then |A*(p)| < and if p is tt one-sided, 

then |A"(p)| > rf^'^. 

The set of parameter values corresponding to diffeomorphisms of maximal entropy is 
closed, while the set of parameter values corresponding to hyperbolic diffeomorphisms is 
open. It follows that not all maximal entropy diffeomorphisms are hyperbolic. We now 
address the question: which properties of hyperbolicity fail in these cases. 

Theorem 2. If f has maximal entropy, but K is not a hyperbolic set for f, then 

(1) There are periodic points p and q in K (not necessarily distinct) so that W'^{p) 
intersects W^{q) tangentially with order 2 contact. 

(2) p is s one-sided, and q is u one-sided. 

(3) The restriction of f to K is not expansive. 

Condition (1) is incompatible with K being a hyperbolic set. Thus this theorem 
describes a specific way in which hyperbolicity fails. Condition (3), which is proved in 
[BS8, Corollary 8.6], asserts that for any e > there are points x and y in K such that 
for all n e Z, d{f'^{x), f'^{y)) < e. Condition (3) is a topological property which is not 
compatible with hyperbolicity. We conclude that when / is not hyperbolic it is not even 
topologically conjugate to any hyperbolic diffeomorphism. 

The proofs of the stated theorems owe much to the theory of quasi-hyperbolicity 
developed in [BS8]. In [BS8] we show that maximal entropy diffeomorphisms are quasi- 
hyperbolic. We also define a singular set C for any quasi-hyperbolic diffeomorphism. Much 
of the work of this paper is devoted to showing that in the maximal entropy case C is finite 
and consists of one-sided periodic points. Further analysis allows us to show that they 
these periodic points have period either 1 or 2. In the case of quadratic mappings we can 
say exactly which points are one-sided. 

We say that a saddle point is non-flipping if A*^ and A* are both positive. 

Theorem 3. Let fa,b be a quadratic mapping with maximal entropy. If fa,b preserves 
orientation, then the unique non-flipping fixed point of f is doubly one-sided. If f reverses 
orientation, then one of its fixed points is stably one-sided, and the other is unstably 
one-sided. There are no other one-sided points in either case. 

We can use our results to describe how hyperbolicity is lost on the boundary of the 
horseshoe region for Henon diffeomorphisms. We focus on the orientation preserving case 
here, but our results allow us to treat the orientation preserving case as well. The parameter 
space for orientation preserving Henon diffeomorphisms is the set {{a,b) :b > 0}. Let us 
define the horseshoe region to be the largest connected open set containing the Devaney- 
Nitecki horseshoes and consisting of hyperbolic diffeomorphisms. Let / = /a,,, 6,, be a point 
on the boundary of the horeshoe region. It follows from the continuity of entropy that / 
has maximal entropy. Theorem 1 tells us that / has the same number of periodic points 
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as the horseshoes and that they are aU saddles. In particular no bifurcations of periodic 
points occur at ao.bo- Let po be the unique non-flipping fixed point for /. It follows 
from Theorem 2 that the stable and unstable manifolds of po have a quadratic homoclinic 
tangency. 




Figure 0.1 

Figure 0.1 shows computer-generated pictures of mappings fa,b with a = 6.0, b = 0.8 
on the left and a = 4.64339843, b = 0.8 on the right.* The curves pictured are the 
stable / unstable manifolds of the non-flipping saddle point po , which is the point marked by 
a disk in each picture at the lower leftmost point of intersection of the stable and unstable 
manifolds. The manifolds themselves are connected; the apparent disconnectedness is a 
result of clipping the picture to a viewbox. There are no tangential intersections evident 
on the left, while there appears to be a tangency on the right. This is consistent with the 
analysis above. 

§1. Background 

Despite the fact that we study real polynomial diffeomorphisms, the proofs of the results 
of this paper depend on the theory of complex polynomial diffeomorphisms. In particular 
the theory of quasi-hyperbolicity which lies at the heart of much of what we do is a 
theory of complex polynomial diffeomorphisms. The notation we use in the paper is 
chosen to simplify the discussion of complex polynomial diffeomorphisms. A polynomial 
diffeomorphisms of will be denoted by /c, or simply /, when no confusion will result. 
Let T{x,y) = {x,y) denote complex conjugation in C^. The flxed point set of complex 
conjugation in is exactly R^. We say that / is real when / : has real 

coefficients, or equivalently, when / commutes with r. When / is real we write /r for the 
restriction of / to R^. 

* We thank Vladimir Veselov for using a computer program that he wrote to generate 
this second set of parameter values for us. 
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Let us consider mappings of the form / = /i o • • • o where 

fji^^y) = (y^Pjiv) - (1-1) 

Pj is a polynomial of degree dj. If we set d= di .. .dm, then it is easily seen that if / has the 
form 1.1 then the degree of / is d. The degree of is also d and, since /^(/r) = h{f^^) 
it follows that / has maximal entropy if and only if does. 

Proposition 1.1. If a real polynomial diifeomorphism f has maximal entropy, then it 
is conjugate via a real polynomial diffeomorphism to a real polynomial diffeomorphism of 
the same degree in the form (1.1). 

Proof. According to [FM] a polynomial diffeomorphism /r of is conjugate via a poly- 
nomial diffeomorphism, (7, to an elementary diffeomorphism or a diffeomorphism in form 
(1.1). Since /r has positive entropy it is not conjugate to an elementary diffeomorphism. 
In [FM] it is also show that a diffeomorphism in the form (1.1) has minimal entropy among 
all elements in its conjugacy class so deg{gji) < deg{fji). Since entropy is a conjugacy 
invariant we have: 

\ogdeg{gn) < logdegifn) = /t(/R) = h{gR). 

Again by [FM], /i((7r) < log(ie5r(5rR) so we conclude that the inequalities are equalities 
and that deg{g-R) = deg{f-R). 

Thus we may assume that we are dealing with maximal entropy polynomial diffeo- 
morphisms written in form (1.1). The mapping fa^h in the Introduction is not in the form 
(1.1), but the linear map L{x,y) = {—y, —x) conjugates fa,b to 

{x,y) {y,y'^ - a- hx). 

In Sections 1 through 4, we are dealing with polynomial diffeomorphisms of all degrees, 
and we will assume that the are given in the form (1.1). 

We recall some standard notation for general polynomial diffeomorphisms of C^. The 
set of points in with bounded forward orbits is denoted by . The set of points 
with bounded backward orbits is denoted by K~ . The sets are defined to be the 
boundaries of K^. The set J is J""" fl J~ and the set K is K'^ fl K~ . Let S denote the 
set of saddle points of /. For a general polynomial diffeomorphism of the closure of <S 
is denoted by J*. For real polynomial diffeomorphism of each of these /-invariant sets 
is also invariant under r. For a real maximal entropy mapping it is proved in [BLS] that 
J* = J — K and furthermore that this set is real; that is K G R^. 

For p e S, there is a holomorphic immersion V'p : C — > such that V'p(O) = P 
and V'p(C) = W^{p). The immersion il^p is well defined up to multiplication by a non- 
zero complex scalar. By using a certain potential function we can choose distinguished 
parametrizations. Define by the formula 

G+{x,y)= hm i^log+|r(x,|/)|. 
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Changing parameter in the domain via a change of coordinates C = a^, a 0, we may 
assume that ipp satisfies 

ICI<i ^ 

With this normahzation, i/j^ is uniquely determined modulo rotation; that is, all such 

mappings are of the form ( 1— > V'p (e*^C)- 

When the diffeomorphism / is real and p e we may choose the parametrization 
of Wp so that it is real, which is to say that ifj = if^p satisfies i/^{C) = r o In this 

case the set 'i(j~'^{K) = t(j~'^{K^) is symmetric with respect to the real axis in C and the 
parametrization is well defined up to multiplication by ±1. In the real case ip(R) C R^, 
and the set ipCR) is equal to the unstable manifold of p with respect to the map /r. 

When / is real and has maximal entropy more is true. In this case every periodic point 
is contained in R^. Let t/j he a, real parametrization. Since i/j is injective, the inverse image 
of the fixed point set in is contained in the fixed point set in C. Thus '(/'"^(R^) = R, 
and iIj~^{K) C R. If p is a w one-sided periodic point then K meets only one component 
of W{p, R) so i(^~'^{K) is contained in one of the rays {C e R : C > 0} or {C G R : C < 0}. 

We define the set of all such unstable parametrizations as ip'^ := {ipp : p e S}. For 

V' e V'p there exist A = e R and /V' e V'/p such that 

ifm)-fm-\)) (1-2) 

for C e C. 

A consequence of the fact that ip~^{K) C R [BS8, Theorem 3.6] is that 

|Ap|>d (1.3) 

Furthermore if p is u one-sided then 

|Ap| > d^. 

The condition that |Ap| is bounded below by a constant greater than one is one of sev- 
eral equivalent conditions that can serve as definitions of the property of quasi-expansion 
defined in [BS8]. Thus, as in [BS8], we see that / and are quasi-expanding. A con- 
sequence of quasi-expansion is that ipg is a normal family (see [ESS, Theorem 1.4]). In 
this case we define to be the set of normal (uniform on compact subsets of C) lim- 
its of elements of Let := {i/j E : ij^{0) — p}. It is a further consequence of 
quasi-expansion that \E'" contains no constant mappings. 

For p E J, the mappings in \E'p have a common image which we denote by V'^{p) 
([BS8, Lemma 2.6]). Let W'^{p) denote the "stable set" of p. This consists of q such that 

lim dist{}-'^pJ-''q) = Q. 

It is proved in [BS8, Proposition 1.4] that V^ip) C W{p). It follows that V^ip) C K~ . 
In many cases the stable set is actually one dimensional complex manifold. When this is 
the case it follows that F"(p) = W{p). 
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Let V^{p) denote the component of ni?(p, e) which contains p. For e sufficiently- 

small V^{p) is a properly embedded variety in B{p, e). Let denote the tangent space to 
this variety at p. It may be that the variety V^{p) is singular at p. In this case we define 
the tangent cone to be the set of limits of secants. 

For V' e we say that Ord(V') = 1 if ip'{0) 0; and if > 1, we say Ord(V') = k 
if V/(0) = ••• = '0('=-i)(O) = 0, ^p^''\0) ^ 0. Since cont ains no constant mappings, 
Ord('i/') is finite for each ip. If e ^s/'"^ and if Ord('0) = k, then there are aj e for 
k < j < oo such that 

^iO^P + akC'' + ak+iC''+^ + ... 

It is easy to show that the tangent cone to the variety V^{p) is actually the 
complex subspace of the tangent space TpC^ spanned by a^. One consequence of this is 
that the span of the ak term depends only on p and not on the particular mapping in 
'^p. (It is possible however that different parametrizations give different values for k.) A 
second consequence is that even when the variety V^{p) is singular the tangent cone is 
actually a complex line and, in what follows, we will refer to E^ as the tangent space. 
The mapping -i/; i— Ord(?/') is an upper semicontinuous function on \E'". For p E J, we 
set t'^{p) — max{Ord('0) : -0 G ^p}. The reality of ip is equivalent to the condition that 

Since is also quasi-expanding, we may repeat the definitions above with / replaced 
by and unstable manifolds replaced by stable manifolds; and in this case we replace 
the superscript uhy s. We set 

Jj^k = {peJ:T\p)=j,T''ip) = k}. 

We define 

y/-{p,n)^yp/----x}t.p. 

Iterating the mapping / defined above, we have mappings r : ^ ^pp defined by 

r(V''/"(c)) = r ov^«/-(A^/-(p,n)-ic). (1.5) 

By (1.3), 

|A"(p,n)| < d-", |A'^(p,n)| > d^. (L6) 

We will give here the proof of Theorem 3. Since / and are quasi-expanding it 
follows that every periodic point in J* is a saddle. Since every periodic point is contained 
in K and K = J* it follows that every periodic point is a saddle. According to [FM] the 
number of fixed points of counted with multiplicity is d"^. Since all periodic points are 
saddles they all have multiplicity one (multiplicity is computed with respect to rather 
than R^). Thus the set of fixed points of has cardinality d^. Since K C R^ all of these 
points are real. 
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§2. The Maximal Entropy Condition and its Consequences 

Let us return to our discussion of the maximal entropy condition. The argument that 
'(/'"^(R^) = R depended on the injectivity of ijj. Even though elements of are obtained 
by taking limits of elements of t/j^ it does not follow that i/j G is injective. In fact 
it need not be the case that '0~^(R^) C R, but the following Proposition shows that a 
related condition still holds. 

Proposition 2.1. For ip G ip~^{K) C R. 

Proof. The image of -0 is contained in it follows that ip~^[K^) = 'i/j~^{K) for i/j G '05 ■ 
Since is harmonic on C'^—K'^, it follows that G^oip is harmonic on C — R C C — iIj~'^K. 
By Harnack's principle, G"*" o is harmonic on C — R for any limit function ij; G If 
G+ o ^/; is zero at some point C G C — R with, say, ^(C) > 0, then it is zero on the upper 
half plane by the minimum principle. By the invariance under complex conjugation, it is 
zero everywhere. But this means that il^{C) C {G~^ = 0} = K~^. By (1.4), this means that 
ip{C) C -fC C R^. Since K is bounded, must be constant. But this is a contradiction 
because '^^ contains no constant mappings. □ 

Our next objective is to find a bound on OTd{ip) for G Set ni^ = maxjr" and 
consider the maximal index j so that Jj,m« is non-empty. Thus Jj,m" is a maximal index 
pair in the language of [BS8]. By [BS8, Proposition 5.2], Jj,m" is a hyperbolic set with 

stable/unstable subspaces given by Ep^'^. 

The notion of a homogeneous parametrization was defined in [BS8, §6]. A homoge- 
neous parametrization of order m, '(/' : C — C^, is one that can be written as i^iC) — (t^iflC^) 
for some a G C — {0} and some non-singular : C — > C^. It follows from [BS8, Lemma 6.5] 
that for every p in a maximal index pair such as Jj,m" there is homogeneous parametriza- 
tion in with order m*^. 

Proposition 2.2. Suppose that ip G is a homogeneous parametrization of order m. 
Then it follows that m < 2. 

Proof. By Proposition 2.1, 'ip~^{J) C R. And from the condition 'ip{() — (/>(C™) it follows 
that ifj~^{ J) is invariant under rotation by m-th roots of unity. Now i(j~'^{ J) is non-empty 
(containing 0) and a non-polar subset of C, since it is the zero set of the continuous, 
subharmonic function G+ o '0. Since a polar set contains no isolated points it follows that 
'ip~^{J) contains a point Co 0- Since the rotations of Co by the m-th roots of unity must 
lie in R, it follows that m < 2. □ 

Corollary 2.4. J = Ji,i U J2,i U Ji,2 U J2,2- 

There are three possibilities to consider. 

(1) J2,i U Ji,2 U J2,2 is empty. In this case it follows from [BS8] that / is hyperbolic. 

(2) J2,2 is empty and J2,i U Ji^2 is non-empty. In this case J2,i and Ji^2 are maximal 
index pairs and are both hyperbolic sets. 

(3) J2,2 is non-empty but J2,i U Ji^2 is empty. In this case J2,2 is a maximal set and is 
hyperbolic. 

(4) J2,2 is non-empty and J2,i U Ji,2 is non-empty. This is the only case in which we do 
not know a priori that points in J2,i U Ji,2 are regular. 
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Proposition 2.5. Forp e J, let i/j G be given. Then ( i— > V'(C) at most two-to-one. 
If is two-to-one, then it has one critical point, which must be real. 

Proof. This follows from Propositfon 2.2 and [BS8, Lemma 4.6]. □ 

Proposition 2.6. Let p be in J*^2, and let V^{p) be regular. Ifipe^p has order 2, there 
is an embedding : C — > such that V'(C) = 0(C^)- 

Proof. By Propositfon 2.5, ip has at most one critical point, which must be C = 0. Thus 
all points of ip{C) — {p} are regular. Since V^{p) is regular, it follows that ip{C) is regular, 
so there is an embedding (f) : C with 0(C) = ij{C). By Proposition 2.3 < 2, 

so J*, 2, being a set of maximal order, is compact. Thus a{p) C J*, 2, so the result follows 
from [BS8, Proposition 4.4]. □ 

If G is one-to-one, then '(/'(C) fl = i^iH). (For if there is a point C C — R 
with '0(C) G R^, then we would also have '0(C) G R^- But C C; contradicting the 
assumption that ip is one-to-one.) If ip is 2-to-l, then ip has a critical point to G R. Let 
us suppose that ip has a quadratic singularity at C = 0, i.e. ■0(C) = p + a2C^ + 0(|C|^)- If 
■0(C) n R^ is a smooth curve, then p divides this curve into two pieces: in Figure 2.1 the 
image of R under ijj is drawn dark, and the image of iR is shaded. By Proposition 2.1, 
the shaded region is disjoint from J. 




Figure 2.1 

Recall that the tangent space to Vf^^{p) at p is Ep^^. We say that V^{p) and V/(p) 
intersect tangentially at p if Ep = Ep. We recall that a{p), the ct-limit set of p, is the set 
of limit points of {f~^p : n > 0}, and the a;-limit set, uj{p), is the set of limit points of 
{/"p : n > 0}. Compactness of J implies that a{p) and (jj{p) are non-empty. The following 
are consequences of Theorem 7.3 of [BS8]. 

Theorem 2.7. Suppose the varieties V^{p) and V/(p) intersect tangentially at p E J (i.e. 
suppose Ep = Ep). Then the a- and uj-limit sets satisfy a{p) C J2,* and uj{p) C J*,2- 

Further, p belongs to J\^\, and the varieties ofVp^^ are regular at p. 

Theorem 2.8. IfVf{p) and V^{p) are tangent at p E J, then the tangency is at most 
second order, i.e. Vf{p) and V^{p) have different curvatures at p. 
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§3. Finiteness of Singular Points 

Let us consider a point p & J where the varieties Vf{p) and V^{p) are nonsingular and 
intersect transversally. We may perform a real, afRne change of coordinates so that in 
the new coordinate (x, y) we have p = (0,0), V^{p) is tangent to the a;-axis at p, and 
V/(p) is tangent to the y-axis at p. let 7rs{x,y) — y and TTu{x,y) — x. For e > let 
A(e) = {C e C : Id < e}. For q e A2(e) fl J let F*/''(g, e) denote the connected component 
of Vq^'^ n 7r~^^A(e) containing q. For e > small we have 

TTs : F^P, e) C A(e/2), tt, : V'ip, e) C A(e/2), (3.1) 

and 

tTs/m : V^^^iP, e) — ^(e) ai'e proper maps of degree 1. (3.2) 

By [BS8, Lemmas 2.1 and 2.2] the varieties Vf^^{q) depend continuously on q. Thus for 
6 > small, (3.1) will hold for the varieties at g if g e ^^(^) ^ J, and the projections 
Ti's/u • V^/'^{q, e) — > A(e) will be proper. 

By a regular box B we will refer to the ensemble of affine coordinate system, projections 
TTg/u, and sets A^(e), A^(5). To begin with, we require that e and S are small enough that 
(3.1) and (3.2) hold. Then we will shrink e and 5 progressively so that the subsequent 
results from Lemmas 3.1 through 3.5 hold. Let us define V^{B) as the set of varieties 

2 

(g, e) for g G A (5) fl J. Further, we define V| as the set of varieties G V {B) such 
that the projection tTsI^/s : — > A(e) has mapping degree j. In a similar way, we define 

V'^{B) and V'j{B). It is evident that elements of Vi^^{B) are represented as graphs of 

analytic functions, and so Vi^^(B) is a compact family of varieties. 

Lemma 3.1. IfV^ G V|, G V^, then the intersection fl consists of jk points 
(counted with "intersection" multiphcity). If e and 5 are sufficiently small, then V* = 
Vf UV|. 

Proof. If is a j-fold branched cover over A(e), then it is homologous to j times the 
class of {0} X A(e) in ii/'2(A^(e), A(e) x 9A(e)). Similarly, is homologous to k times 
the class of A(e) x {0} in if2(A^(e), 9A(e) x A(e)). Thus the intersection number of the 
classes [V^] and [V^] is jk times the intersection number of {0} x A(e) and A(e) x {0}, 
which is 1. 

For g G J n A^(5), we let j = jq denote the branching degree of 7r„ : F"(g, e) — > A(e). 
Let us take a sequence qu ^ P such that j = jq^ is constant and ifj"^^ ^ Let C 

C denote the connected component of ^^^(^^"(gfc, e)) containing 0. For each xq G A(e) and 
each k we have G cufc : tt^ ° V'qfc(C) — ^o} — j- By [BS8, Lemma 2.1] there exists r > 
such that Uk C {|C| < r} for all k. It follows that #{|C| < r : 7r„oV'"(C) = a;o} > j. By (3.2) 
we have a holomorphic map 7r~^ : A(e) — > V^ip, e), so we conclude that tt~^tTu'4>p = V'p is 
at least j-to-1. It follows from Proposition 2.3 that j < 2. □ 
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The sets S := A'^{e) fl and := A^(S) n are squares in R^. We define the 
vertical boundary dyS (resp. the horizontal boundary dhS) as the portion of (the square) 
dS which is vertical (resp. horizontal). For q G J fl 5*0, we define 7^ as the intersection 
V'{q, e) n R2. Thus 7^ = 7|(-B) is determined by B. We define V = T%B) to be the set 
of curves 7^ with q e Sq = So{B). We define = Fj(;B) as the set of curves 7* n with 
ys g ys rpj^g layout of this configuration is illustrated in Figure 3.1: 7* e rf(B), and 

7*, 7^ e F2(B). By the reality condition, ^p^^ e F*/'" is a one-dimensional set, so ^p^^ is 

regular if and only if Vf^^{p) is regular. 
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Figure 3.1 

Corollary 3.2. If "f^ E F^ and 7" G F^, then the number of points of 7* fl 7^* counted 
with multipUcity, is equal to jk. 

Proof. This is a direct consequence of Lemma 3.1 and the fact that V"^ n C R^. □ 

If ip E has order 2, and if 7^ is regular, then by Proposition 2.6 there is an 
embedding (p such that ipiC) = (/>(C^). It follows that V(C) nR^ = ?/'(R) U?/'(iR). Working 
inside a box B, we write (7^ )^ := i^CR) H 7^ and (7^ )* := '(/'(^R) ^ 7p ■ The phantom gray 
region (7^)% as in Figure 2.1, is disjoint from J. We state this observation as follows. 

Lemma 3.3. If p G 7^,2 and 7^ is regular, then p is u one-sided; if p G J2,* and 7^ is 
regular, then p is s one-sided. 

Let g be a point of J for which V^^ is regular For ^/^ G we define the set uj^ as 
the connected component of ip~^V^{q,e) containing the origin. Since tt^ o ip is an entire 
function, a;/ is simply connected. By the reality condition on if^, uj^ is invariant under 
complex conjugation. Thus fl R is a (connected) interval (—a, 6). It follows that 7^ is 
connected submanifold of 5". We refer to '0(— a) and il){b) as the endpoints of 7^. Since 
9y (g, e) C A(e) x 9A(e), it follows that the endpoints of 7^ lie in dhS. 

Lemma 3.4. 1/7 G F*, then 7 G Ff if the endpoints of 7 lie in different components of 

dhS . Otherwise (if the endpoints lie in the same component of dhS), 7 G F^. 

Proof. The horizontal boundary dyS consists of fibers of the projection tTs intersected 
with R^. By Lemma 3.1, the multiplicity of the projection is no greater than 2. If 7* 
intersects one of the fibers in two points, then the multiplicity is in fact equal to 2. 
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Now we prove the first assertion of the Lemma. Suppose that 7* has one endpoint in 
each component of dhS. Then for each point t G A(e) fl R, there is a point s G (—a, h) such 
that il){s) = t. Now there cannot be a point C ^ C — R with '(/'(C) = t, for by the rcahty 
condition we would have ip{C) — t-i which would give 3 solutions. Finally, we cannot have 
the situation where ii~'^{t) n 7* consists of exactly two points. For, in this case, we may 
assume that Tr^ a)) = — e and 7Ts{il^{b)) = e. Then, arguing as in Calculus, there must 
be a nearby t' G (— e, e) for which 7r~^{t') consists of 3 points. □ 



Lemma 3.5. Let B be a regular box. After possibly shrinking 5, it follows that if q G 
J2,* n 5*0 and if 7^ is regular, it follows that 7* G Ff . Similarly, if q G J*, 2 H Sq, and if 7^ 
is regular, then 7^ G F". 

Proof. It follows from Lemma 3.1 and Corollary 3.2 that 7^ belongs to Ff or F|. If there 
is no 6 satisfying the conclusion of the Lemma, then there is a sequence qj 0, qj G J2,*, 
7q_. regular, and 7q_. G F|. Since ■y^^ is regular, there exists i/^j G and a holomorphic 
embedding (pj such that ipjiQ — </>j(C^)- We may extract a subsequence such that there is 
a limit i/j^ 



Now since ip^. G F^ it follows that for xq G A(e), tt^ ^{xq) (^V^. consists of two points. 



Thus 



#(7r, o rir\xo) = #{C e C : 7r.(/>(C') = xo} > 4. 



By [BS8, Lemma 2.1] this set is contained in a disk {|^| < r}, independent of j. Letting 
J — >• 00 we obtain #(7rx o -i/;)~^(xo) > 4. By (3.2), there exists ao G Vp such that Vp fl 
7r~^(a;o) = {00} is a single point so #{7rsip)~^{xo) — #'0~^(ao) > 4, which contradicts 
Lemma 2.3. □ 
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One-sided Points 

Figure 3.2 

Let B be a regular box, and let G n J*, 2 be a point with 7^ G Ff . Then — 7* 
consists of two components, which we may label S'^ and S^, as in Figure 3.2. That is, S'^ 
contains the variety of ip(R) at q, and 5* contains the local variety of the phantom region 
'0(iR) at q. 

Lemma 3.6. For p G J2,2, we may construct a regular box B about p. For q E SqC] J2,2, 
Yq belongs to Ff . If we split S - Yq = S'' U S' as above, then 5o n 5^ n J = 0. (And the 
corresponding statement holds for 5" — 7^ .j 

Proof. By hypothesis, J2,2 7^ 0- Thus 2 = maxr" = maxr^, so by [BS8, Proposition 5.2] 
J2,2 is a hyperbolic set. It follows that 7^^" are nonsingular and transversal. In particular. 
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for q = p, we may construct a regular box B about p. If B is sufficiently small, then it 



follows by hyperbolicity that 7*/'" G F^^" for all q E SqCi J2,2- 
To complete the proof, we must show that 5*0 fl 5"* fl J = 
exists r e S'o n 5* n J, then by Corollary 3.2 7^ H 7^ 7^ 0. Since 7^ cannot intersect 7^, it 
follows that 7^ n 7" must lie inside the phantom region of 7", which is forbidden. 



For otherwise, if there 



□ 



Theorem 3.7. J2,2 is Unite. 

Proof. By Lemma 3.6 we may construct a regular box B about any p G J2,2- Let us select 
a finite family of boxes B such that the corresponding sets Sq cover J2,2- Let us fix one 
of these sets Sq. If g G J2,2 H Sq, then q corresponds to one of the four types of doubly 
one-sided point pictured on the left hand side of Figure 3.3. For each of these four cases, it 
follows from Lemma 3.6 that the set J nS must lie in the quadrant bounded by the solid 
lines. 




Doubly One-sided Points 

Figure 3.3 

Now we consider the possibility that 5*0 fl J2,2 might consist of more than one point. 
Let us start by supposing that a pair of points pi,P2 G J belong to the same box Sq- The 
only way that two types of box can both occupy the same set S is if they are of type 1 
and 3 or type 2 and 4. The situation where points of type 2 and 4 occupy the same box 
S is pictured on the right hand side of Figure 3.3, and by Lemma 3.6 J fl 5*0 is contained 
in the shaded region. It follows that J fl 5*0 cannot contain a third point r. If there were, 
it would lie in the shaded portion; but as r is one-sided, then the phantom (gray prong) 
region would necessarily intersect the sides of the shaded region. 

Since we have covered J2,2 by finitely many sets and #(J2,2 H 5') < 2, it follows 
that J2,2 is finite. □ 

Theorem 3.8. If p G J2,i U Ji,2, then Vp^^ is regular at p. 

Proof. Without loss of generality we may assume that p G Ji,2- If o:{p) n Ji,2 ^ it follows 
from [BS8, Theorem 5.5] that V^{p) is regular. The other possibility is that a{p) C J2,2 
by Corollary 2.4. Since J2,2 is hyperbolic and finite, it is an isolated hyperbolic set. By [R, 
p. 380] there exists q G J2,2 such that p G VV^iq). By (1.4) it follows that C Wiq), 
and so V^{p) is regular. □ 

For p G Ji,2 it follows from Theorem 3.8 that 7^ is regular. By Theorem 2.7, 7p is 
regular and transverse to 7^. If p G J2,2, then we saw in the proof of Theorem 3.7 that 
7p and 7^ are regular and transverse at p. Thus if p G J*, 2 we may construct a regular 
box B centered at p. The following result will involve shrinking this box B. Before giving 
the proof, we make an observation concerning the relationship between shrinking and the 
multiplicities of varieties. Let tt^ and tt^ be the projections associated with B. If V G V^, 
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then the projection tt^ '■ V ^ A(e) has mapping degree m. This is equivalent to the 
statement that the total multiplicities of the critical points of tt^^ is m — 1. It follows that if 
we shrink the box B to B' := {q E B : TVu{q) G A(e'^), iVsiq) G A(e2)} for some e' < e, then 
each component of V HB' belongs to Vj^(i3') for j < m. It follows that if 5" = fl i3' is a 
regular box obtained by shrinking B in this way, then for each 7 e r^(S'), 7 n S" G r"(S"). 
And for each 7 G T2{S), we have that either 7 fl S" is connected and belongs to Fg; or 

7 ns" consists of two components, each of which belongs to Ti{S'). In this sense, Tl^^{S) 
is preserved under shrinking. 

Lemma 3.9. For p E J^^2 there is a regular box B centered at p with the properties: 

1. For all 7 G r^, 7 n d^S C S" . 

2. For aii 7 G r2 , 7 n S"^ consists of two components 71 and 72, as in Figure 3.4. 

3. For all 77 G r|, #(71 n 77) = #(72 n 77) = 2. 

Proof. As we noted in the previous paragraph, we may construct a regular box B centered 
at p. Now we show that we may shrink and S so that 1,2, and 3 hold. Since p G J*,2, 
7p will have a phantom region, which we may assume extends to the right hand side, as 
in Figure 3.4. In order to establish 1, we must show that for 7 G F2, the endpoints of 7 
lie in the left hand side of the vertical boundary of 5". Let 7' G F2 denote any unstable 
arc whose endpoints lie in the right hand side of dyS. For r G 5*0 fl J, 7^ fl 7 consists 
of two points, which means that any 7' must loop around to the left of 7^. If we shrink 
S in the unstable direction, i.e., replace it with S fl 7r~^A(e') with e' > small enough 
that there exists r E So (1 J with 7^ fl 5" = 0, then all 7' become simple in S'. That is. 

Assertion 2 follows from assertion 1, as is illustrated in the left hand side of Figure 
3.4. 




Figure 3.4 

To prove assertion 3, we consider first the case where there is an ry G F^ lying below 7^ , 
as in the central picture in Figure 3.4. (The case where there rj lies above 7^ is analogous.) 
We may shrink 5*0 so that for all r G J fl 5*0, 7^ lies between rj and 7^. In this case we 
consider 7 G F2 lying between rj and 7^ and o" G F|. The case drawn in the central picture 
in Figure 3.4 shows the endpoints of a in the top of the boundary d^S. (The other case, 
where the endpoints are in the bottom portion of dhS is analogous.) As is pictured, r/ cuts 
off two pieces ai and a"2, and each of these intersects 7^, j = 1,2. Thus #((T n 7^) = 2. 
This proves assertion 3 in this case. 

The alternative to this case is that rj for all curves rj eV^ lying below 7^ . If this 
happens, we consider G{r]), which is the set of all 7" such that 7^ G and 7" separates 
r] from p. We claim that we may shrink such that for r E Sq below 7^ , 7^ lies between 
G{r]) and 7^. If this happens, then we see that any cr e r| has two components ui and 
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(T2 as in the right hand side of Figure 3.4. These components intersect 7 as desired. The 

alternative is that there are points r,- G 5*0 fl J, lying below 7!^, and such that r, — * p. 



But then we have that 7^^ "fp in the topology of the Hausdorff metric. In this case, we 
let S' denote an arbitrarily small shrinking of S, and it follows that 7"^. fl S' is ultimately 
disconnected. Thus a component of 7^^. serves as the curve 77 as we considered at first. □ 

Theorem 3.10. J2,i ^ Ji,2 is Unite. 

Proof. It suffices to show that Ji,2 is finite. Write X = Ji^2 U J2,2- For each p & X, 
we may construct a regular box B centered at p, satisfying the conclusions of Lemma 3.9. 
Since X is compact, we may select a finite number of regular boxes B such that the sets 
So cover X. 

Let us fix one of these boxes. We claim: There are (at most) two verticals, 7^ and 7^, 
with the property that S'o fl X C 7^ U 7^. Since p E X, it is u one-sided. Without loss of 
generality we may assume that the phantom region of 7^ is on the right, so that SqH J 
lies to the left of 7^. To establish the claim, we show that for any two points q,r E X f] Sq 
such that q,r ^ 7^, then it follows that 7^ =7^. 

Let us assume first that 7^ and 7^ both belong to F^^. If r ^ 7^, then we have 
7g n 7^ 0, as pictured in Figure 3.5. There are three possibilities for the 7^. The first 
(on the left of Figure 3.5) is that 7^ e Ff . But this is not possible, since the phantom 
region of 7^ blocks 7* from reaching the upper portion of dhS. The next two possibilities 
are that 7^ e F|. In both cases, 7^ ("17^ — 0, and 7^ cannot intersect the phantom region of 
7^. In the central picture of Figure 3.4, we see that 7^ must come out of the box bounded 
by 7g and 7^. But the portion that is drawn shows #(7^ H 7^) = 2, and thus 7^ cannot 
intersect 7^ again. Thus 7* n 7^ = 0, which is a contradiction. In the last case, on the 
right of Figure 3.5, we again have #(7* n 7^) = 2 already, so it is not possible for 7^ to 
cross 7^ again, so it cannot intersect dhS, which is a contradiction. 

Now let us suppose that one or both of 7^, 7^ belongs to Tl^- We will refer to these 
as 7^. As in Lemma 3.9, 7" fl consists of two pieces, 71 and 72. One of these, say 71, 
contains the point x. By Lemma 3.9, we have #(7* fl 7^) = 2 for any 7^ G F|. Thus we 
replace 7^ in Figure 3.5 by 71 and proceed as before. This proves the claim. 

Since there are only finitely many regular boxes in our covering of X, it follows that 
Ji,2 is contained in the union of a finite set {7! , . . . , 7^} of segments of stable manifolds. 
We let Fj denote the closure of the union of all the arcs 7? which are contained in the 
global stable manifold W^{rj) ^ Ij- It follows that / permutes the finite family of sets 
{Ff, . . . ,F^}. Thus, passing to a power of /, we have /*(Ff n Ji^2) = Ff fl Ji,2- Now 
rf n Ji,2 is an /-invariant, compact subset of W^{ri), and /* is contracting on W^{ri), so 
Ff n Ji,2 must be a single point. We conclude that Ji,2 is finite. □ 
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Corollary 3.11. For anyp e J and ip G \I/p, '(/'(C) is a nonsingular (complex) submanifold 
of C^, and V'(C) fl is a nonsingular (real) submanifold of R^. 

Proof. If ip has no critical point, then il^{C) is nonsingular. And by our earlier discussion 
of the reality condition, it follows that if if) has no critical point, then '0(C) Pi R^ is a 
nonsingular, real one-dimensional submanifold of R^. 

liij; e has a critical point, then by Proposition 2.5, ip there is just one critical point 

Co- The sequence f~'^ip = f~'^ip{X{p, —n)~^() E ^ f-^p has a critical point at A(p, — n)Co- 
For a subsequence f~'^^p q E a{p), we may pass to a further subsequence such that 
f-^jif; converges to i/j E \E'q. Since A(p, — n) — > as n ^ cxo, '0 has a critical point at C = 0. 
Thus q E J*, 2- Since J2,* U J*^2 is a finite set of saddle points, we have p E W^ip). Thus 
V'(C) C W'^{q), and so this set and ipiC) D R^ are both regular. □ 

§4. Hyperbolicity and Tangencies 

In §3 we showed that C :— J2,* U J*^2 is a finite union of saddle points. We show next that 
all tangential intersections lie in stable manifolds of J*^2 and unstable manifolds of J2,*- In 
Theorem 4.2 we show that for p E J*, 2, the stable manifold W^{p) contains a heteroclinic 
tangency. The condition for hyperbolicity is characterized (Theorem 4.4) in terms of the 
existence of heteroclinic tangencies. 

Theorem 4.1. If p E J and = E^, then p E W%J^,2) n M^"(J2,*). 

Proof. If p is a point of tangency, then by Theorem 2.7, a{p) C J2,* and u!{p) C J*,2- 
Since J2,* U J*, 2 is a finite set of saddle points, it follows that there exist q E J2,* and 
r E J*,2 such that p E W{q) f\W^{r). ' □ 

Theorem 4.2. If p E J*, 2 then there exists q E J2,* such that W^{p) intersects W'^{q) 
tangentially. 

Proof. By §3, C is finite. For each point p E J*, 2, there is a point q E C such that 
W^{p) intersects W'^{q) tangentially, by [BS8, Theorem 8.10]. And by Theorem 2.7 we 
have q E J2,*. □ 

Corollary 4.3. If Ji,2 ^ 0, then J2,i ^ 0. 

Theorem 4.4. The following are equivalent for a real, polynomial mapping of maximal 
entropy: 

1. f is not hyperbolic. 

2. J2,* U J*, 2 is non-empty. 

3. There are saddle points p and q such that W^{p) intersects W'^{q) tangentially. 

Remark. By Theorem 4.1, the saddle points p and q in condition 3 satisfy p E J*, 2 and 
q e J2,*- 

Proof. (1) =^ (2). If J2,* U J*, 2 7^ 0, then by Theorem 4.2 there is a tangency between 
VF*(J*,2) and VF"(J2,*)- Thus / is not hyperboUc. 

(2) =^ (1). If J2,* U J*^2 = 07 then J = Ji i. It follows that Jij is compact, so by 
[BS8, Proposition 5.2] Ji i is a hyperbolic set. 

The implication (2) ^ (3) follows from Theorem 4.2, and (3) =^ (2) follows from 
Theorem 2.7. □ 
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Let T denote the set of points of tangential intersection between W^{a) and W"^{b), for 
a,b & J. By [BS8, Theorem 8.10], T is a discrete subset of Ji^. Since the parametrizations 

are nonsingular in Ji i, the curves W*/" = {7r^" : r G form a lamination of a 

neighborhood of p. If p G Ji^i — T, the the laminations and are transverse at p, 
so they define a local product structure on J in a neighborhood of p. 

Let us fix a point p E T. We cannot construct a regular box centered at p since it is 
a point of tangcncy, but we will construct a box with many of the same properties. We 
choose a real analytic coordinate system such that the square 5" := < e} C 

is centered at p = (0,0), and has the properties that 7^ = {x — 0,\y\ < e}, and the 
projections tt^ : 7^ — (— e, e) are proper, where as before TTu{x,y) = x, TTs{x,y) = y, 

and we use the notation 7^^" : Vq^^ H S H R^. By Theorem 2.8, the multiplicity of the 
intersection of 7* and 7^ at p must be 2. Thus 7^ e T2{S), and so by Lemma 3.4 7^ lies 
to one side of 7^, as is pictured on the left hand side of Figure 4.1. For 5'o := {|a;|, < 5} 

sufficiently small, we have (3.1), and tt^/^ : 7^^^ — > (— e, e) is proper for q E Sq (IJ. 

The configuration of the curves in the third picture of Figure 4.1 follows from Lemma 
3.4 and Corollary 3.2, since there must be two points of intersection between stable and 
unstable manifolds in S. This arrangement is associated with the failure of topological 
expansivity. 




S S s s 

Stable/Unstable Laminations Near a Tangency 



Figure 4.1 

Corollary 4.5. IfrET, then there is a neighborhood Sq of r such that JHSq is disjoint 
from the region shaded in the right hand picture in Figure 4.1. 

§5. One-Sided Points 

We have shown that the set of critical points C is a finite set of one-sided points. We 
use one-sided points to show (Theorem 5.2) that K is always a Cantor set. We analyze 
more carefully the possibilities for one-sided points, and we obtain Propositions 5.8 and 
5.9, which combine to prove Theorem 3 in the Introduction.* 

* We wish to thank Andre de Carvalho for a suggestion that resulted in this part of the 
paper. 



17 



Theorem 5.1. If f is hyperbolic, then there exist stably and unstably one-sided points. 

Proof. The set K is saturated in the sense that W^(p) n W^iq) C K for all p,q e K. We 
use the following result of Newhouse and Palis [NP], as it is presented in [BL, Proposition 
2.1.1, item 6]: If / does not have an unstably one-sided point, then i^T is a hyperbolic 
attractor. Since K is a basic set, it follows that if it is an attractor, then the set of points 
attracted to K is open. On the other hand, the set of points attracted to K is K~^, which 
is a closed, proper subset of R^, and is thus not open. Thus / has an unstably one-sided 
point. Repeating the argument for gives a stably one-sided point. □ 

Theorem 5.2. If f has maximal entropy, then K is a Cantor set. 

Proof. Since K is the zero set of a continuous, plurisubharmonic function G on D R^, 
it follows that no point of K can be isolated. Thus it suffices to show that K is totally 
disconnected. Both W^{K) and W'^{K) are laminations in a neighborhood of J7i,i = K—C. 
Let T denote the tangencies between W\K) and W^iK). By [BS8, Theorem 8.10] TUC 
is a countable, closed set. Thus it suffices to show that K is totally disconnected in a 
neighborhood of each point of K — {T UC). 

Now each point of K — (T U C) has a neighborhood R such that Rn K has local 
product structure. The local product structure means that for any reJCnt/, i?nJCis 
homeomorphic to {K fl W]^ ioc('^)) x (-^ H ioc(^))- 

By Theorem 5.1, there are an s one-sided periodic point p and a u one-sided point q. 
Let A denote the set of transverse intersections of W^{p) and W^{q). By [BLS, Theorem 
9.6] A is dense in K r\U. It follows from the local product structure that the transverse 
intersections between W'^{p) and W^i^^{r) are dense in W^i^^{r) for each r E K n U . 
Since p is s one-sided, K fl W^{p) lies to one side of p in W^{p). This one-sidedness 
propagates along the unstable manifold W^{p), and so for any point b e W^{p)nWf^ lod''^)^ 
K n Wlii^^{r) lies (locally) to one side of h in Wl^i^^{r). Thus the set of disconnections 
of K n Wli i^^{r) is dense in K n Wl^ i^^{r), which means that K n Wl^ i^^{r) is totally 
disconnected. Similarly, K n W'^i^^ir) is totally disconnected. By the local product 
structure, K r\Ris totally disconnected, and thus K is disconnected. □ 

By a (topological) attractor we will mean a compact, invariant S whose stable set 
W^{S) := {q : lim„^+oo d{f^q, S) = 0} has nonempty interior. 

Corollary 5.3. If f has maximal entropy, then and K~ have no interior, and thus 
K contains no attractors or repellors. 

Proof. As in the proof of Theorem 5.2, we consider a local product neighborhood R of 
a point of K — (T U C). By the local product structure, fl i? is homeomorphic to 
{K n W]^ zoc(^)) ^ ioc(^)- Since K fl W]^ ioc(^) totally disconnected, it contains no 
interior. Thus Rr\ contains no interior. 

If S is an attractor, it must be contained in K, and thus the basin B{S) must be 
contained in However, since K'^ has no interior, it follows that B{S) can have no 

interior. □ 
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Recall that if 7? is m one-sided, then W'^{p) — {p} has a component which is disjoint from 
J. No point of J n W^Ip) can be isolated, so only one of the components of W'^{p) — {p} 
can be disjoint from J. We call this component the (unstable) separatrix associated with 
p. 

Now let us note that if p is a saddle point of / with period n, then Df^{p) has 
eigenvalues jA^^j > 1 > [A*! > 0. If p is it one-sided, / must preserve the unstable separatrix, 
and so A'^ > 0. Similarly, if p is s one-sided, we have A* > 0. 

Lemma 5.4. Let p ^ K be u one-sided, and let S be the separatrix associated with p and 
which is disjoint from K. Then S is properly embedded in — {p}. 

Proof. Consider the uniformization ip"^ : C — > W^lp) of the complex unstable manifold 
through p. Since p is u one-sided, we may assume that its separatrix S corresponds to the 
positive real axis in C, and thus G~^'i(j'^{Q > for C G R, C > 0. Now ■(/'"(O) = p, and there 
is A" > 1 such that G+V'^IA^) = d-G+i;''{C). Thus lim^^+00 G+'0"(C) = +00. Since 
{G+ < c} n J~ is compact, it follows that lim^_>+oo ip'^iC) = +00, and thus S is properly 
embedded in R^. □ 

Let O = {pi, . . .,pj} denote the set of u one-sided points. Let ^i, ■ ■ - Sj denote the 
corresponding separatrices. By Lemma 5.4, Si is an arc in the sphere S"^ = R^ U {00} 
which connects pi to 00. We let Si denote the germ at infinity of Si, i.e. Si denotes the set 
of sub-arcs of 5"^ containing 00. We consider a system of neighborhoods of 00 in S'^ with 
the property that dW is homeomorphic to S^, and dW fl Si consists of a unique point, 
for each i. It follows that for such a neighborhood, W f] (R^ — Ui=i ^i) consists of j open 
sets V, each containing 00 in its closure. Let V denote the germ at infinity corresponding 
to V. We will define a graph Q whose vertices be the classes Si, and whose edges are the 
germs V. A vertex Si is contained in an edge V if the germ of 5"^ is contained in dV. It 
follows that Q is homeomorphic to dW. Since / maps the separatrices Si to themselves, it 
follows that the system of neighborhoods W is also preserved by /. Thus the structure of 
G is preserved. If / preserves/reverses orientation, fW has the same/opposite orientation 
as W. Thus we see that we have: 

Lemma 5.5. Q has the combinatorial structure of a simplicial circle, and f induces a 
simplicial homeomorphism f on Q. If f preserves /reverses orientation, then so does f. 

Let us note that if / has the form (1.1), then 

fix,y)^{y,ey^-\ ax). (5.1) 

We have a > if / preserves orientation, and a < if / reverses orientation. We conjugate 

by t{x, y) = {ax, Py) with a, /3 G R, so that e = ±1. If d is even, we require e = +1. If d 
is odd, we define e(/) = e. If /i and /2 are both of odd degree and in the form (5.1), then 
c(/i/2) = e(/i)e(/2). Note that f~^{x,y) = {a~^{€x'^ — y),x), and thus may be put 
in the form (5.1) after conjugation by i'{x,y) — {y,x) and a mapping of the form r. If d 
is odd, then e(/~^) = ±e(/), with the plus sign occurring iff / preserves orientation 

We write V+ = {{x,y) G R^ : \y\ > max(i?, |a;|)} as V+ = U V^, with := 
n {y > 0} and V2' := V^"*" H {y < 0}. We choose R large enough that V, give a 
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filtration, i.e. fV+ C V+ and f(V U V+) CVUV+. The condition e(/) = 1 is equivalent 
to f{V{^) C V-^. In this case, it follows that f{V2~) C V-^ if the degree d is even, and 
f{V^) C 1/2^ if is odd. 

Theorem 5.6. If f preserves orientation, and if e(/) = +1, then all the pi are fixed. If 

e(/) = —1, then all the pi have period 2. 

Proof. Recall that for each unstably one-sided point, the separatrix Si is unique. Let 
Sij^j . . . , Si^ denote the separatrices corresponding to V-^ . That is, these are the separatri- 
ces whose germs at infinity are contained in V-^ . Let Ii C G denote the subgraph whose 
vertices are the separatrices corresponding to V-^ and whose edges are the open sets V 
with V C V-^. It follows that Ti is a proper subinterval of Q. Similarly, we let I2 denote 
the interval generated by the separatrices whose germs arc contained in V^"^ . Note that all 
of the separatrices Si are subsets of unstable manifolds. Thus their germs are contained 
in , and so they belong to either Ii or I2. 

If e(/) = 1, then fV^ C V-^. Thus / maps Xi to itself. If / preserves orientation, 
then / : Xi — > Xi is an orientation-preserving simplicial homeomorphism. It follows that 
/ is the identity on Xi, and so / is the identity on Q. Thus / maps each edge and each 
vertex to itself, or f{pi) = Pi for every i; and this completes the proof in this case. 

The remaining case is e(/) = —1, which implies that the degree is odd, and thus 
fV^ C and fV^ C . This means that / : Xi ^ X2, and / : X2 ^ Xi. Thus none 
of the separatrices can be fixed. On the other hand, preserves orientation and satisfies 
e(/^) = 1. By the argument above, these points are fixed for so their periods are equal 
to 2. □ 

Corollary 5.7. All one-sided points have period 1 or 2. 

Proof. Without loss of generality, we may consider only unstably one-sided points. The 
mapping is orientation-preserving, and e(/^) = By Theorem 5.6, each one-sided 
point is fixed for Thus the period is 1 or 2. □ 

Let / be a real, quadratic diffeomorphism of maximal entropy. If / preserves ori- 
entation, then one of the saddle points, which we will call p+, has positive multipliers 
A" > > 0. The other fixed point has negative multipliers. 

Proposition 5.8. Suppose f is quadratic and orientation-preserving. Then the fixed 
point is both stably and unstably one-sided. No other point is one-sided. 

Proof. Let p denote an unstably one-sided point for /. By Lemma 5.6, p is a fixed point. 
If p is the saddle point with negative multipliers, it cannot be one-sided. Thus it must be 
the saddle point which has positive multipliers. Similarly, the stably one-sided point 
must also be p+, so that p+ is the only one-sided point, and it is doubly one-sided. □ 
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Orientation-Reversing Quadratic 

Figure 5.1 

Let / be a real, quadratic diffeomorphism of maximal entropy which reverses orien- 
tation. Then the fixed points are a pair of saddles p± with the property ±A"(p±) > > 

Proposition 5.9. If f is an orientation-reversing quadratic map, then the one-sided points 
are the Gxed points p±, and and p± is u/s-one-sided. 

Proof. If p is a one-sided point, then the period of p must be 1 or 2. We show first that it 
cannot be 2. If g is a fixed point of / with multipliers A^/*(g), then g is a also fixed point 
of and it has multipliers (A"/'^(q'))^ > 0. 

Now let h be an orientation preserving map of R^. For a saddle fixed point r of a 
mapping h, we define d{h, r) to be if the multipliers of /i at r are both positive, and we 
set 5{h^r) = —1 if the multipliers are both negative. If the degree of h is even, it follows 
from the Lefschetz Fixed Point Formula (cf. [F]) that ^ 5{h, r) = 0, where we sum over all 
the fixed points of h. Now we apply this to the map h = f"^, which is orientation- preserving 
and degree 4. There are 4 fixed points of h, corresponding to the 2 fixed points of / and 
a 2-cycle for /. It follows that {^1,^2} is the 2-cycle of /, we must have d{h,pj) = —1 for 

i = i,2. 

On the other hand, suppose that pi is one-sided with separatrix 5"!. Then p2 is 
also one-sided, with separatrix 5*2. Now maps the separatrix Si to itself, and thus 
the eigenvalue of Df'^{pi) must be positive. This means that S{f^,pi) = +1, which is a 
contradiction. Thus the only one-sided points are the fixed points of /. 

Since / reverses orientation, each periodic point satisfies A'^A* < 0, and thus A'^, A'^ 
cannot both be positive. Thus p cannot be doubly one-sided. 

Thus one of the fixed points must be stably one-sided with A'^ > > A" for this point. 
The other fixed point must be unstably one-sided and must have A'^ > > A*. □ 
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Proposition 5.10. Suppose that f reverses orientation and that e(/) = +1. If d is even, 
then at most one u one-sided point can be a fixed point; if d is odd, then at most two u 
one-sided points can be fixed. 

Proof. Wc construct the subintervals Ii and I2 as in the proof of Theorem 5.6. If the 
degree of / is even, then fV^ C and thus X2 is empty. The induced map / : Xi — Xi 
is an orientation-reversing simphcial homeomorphism. The simphcial map / can fix at 
most one vertex of Xi (which happens when the number of vertices in Xi is odd). If d is 
odd, then fV2' C V2', so that each of the restrictions /|Xi and /IX2 can have at most one 
fixed point. □ 
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